Validation of the applicability of the traditional Chinese 
version of the University of Pennsylvania Smell 
Identification Test in patients with chronic 
rhinosinusitis 

Rong-San Jiang, M.D., Ph.D./' 2 ' 3 Li-Te Kuo, M.D., 1 Shang-Heng Wu, M.D., 1 
Mao-Chang Su, M.D V Ph.D., 2 ' 4 and Kai-Li Liang, M.D. 1 ' 2 ' 3 

ABSTRACT 

The 40-item University of Pennsylvania Smell Identification Test (UPSIT) is the most widely used smell test in the world. 
Presently, culturally modified versions of this test are available in multiple languages. A traditional Chinese version of the 
UPSIT (UPSIT-TC) has been developed for administration in Taiwan. The purpose of this study was to investigate the validity 
and reliability of the UPSIT-TC in Taiwanese patients with chronic rhinosinusitis (CRS). The phenylethyl alcohol (PEA) odor 
detection threshold test, the North American version of UPSIT (UPSIT-NA), and the UPSIT-TC were administered to 40 
healthy subjects and to 100 CRS patients before and after functional endoscopic sinus surgery (FESS). The UPSIT-TC showed 
good internal consistency (Cronbach's alpha = 0.887, 0.886, and 0.870 at three test occasions) and test-retest reliability (p < 
0.001). The scores of UPSIT-TC were significantly correlated to the PEA thresholds (p < 0.001). The UPSIT-TC scores were 
significantly higher than those of the UPSIT-NA (p = 0.028) when analysis was performed with logistic regression with 
independent variables including test occasions (before or after FESS), test methods (UPSIT-NA or UPSIT-TC), status of polyp 
(with or without), and PEA thresholds (improved or did not improve). In addition, there were significant between-group 
differences in UPSIT-TC scores including healthy versus CRS, CRS with polyps versus CRS without polyps, and PEA 
thresholds improved versus PEA thresholds which did not improve. The UPSIT-TC is reliable and valid for measuring olfactory 
function in Taiwanese patients with rhinosinusitis. In addition, the UPSIT-TC clearly resulted in better performance than that 
of UPSIT-NA. 

(Allergy Rhinol 5:e28-e35, 2014; doi: 10.2500/ar.2014.5.0084) 



Despite the fact that a number of clinical olfactory 
tests, most notably tests of odor identification, 
detection, discrimination, and memory, have been de- 
scribed in the literature, only a few have achieved 
widespread acceptance and are available commer- 
cially. 1 The most widely used of these tests is the 
University of Pennsylvania Smell Identification Test 
(UPSIT). 2 UPSIT has been administered to nearly 
500,000 patients. 1 The development of this test has 
allowed for accurate and convenient testing of olfac- 
tory function without the use of complex olfactometric 
equipment, cumbersome bottles, or pen-like devices. 3 
However, in rare instances parosmia may mask the 
true ability of a patient to identify odors, in common 
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with other odor identification tests. 1 Moreover, most 
odor identification tests have cultural biases and the 
same test may not be applicable for persons of all ages 
and settings. 4 

Because of its wide applicability, the North Ameri- 
can version UPSIT (UPSIT-NA) has been translated 
into multiple language versions. For example, there are 
British English, Dutch, French, Italian, German, Japa- 
nese, Korean, Portuguese, and Spanish versions of the 
UPSIT. 1 In most versions, a few UPSIT items or re- 
sponse alternatives have been modified to take into 
account cultural differences and to allow for the use of 
common norms. In our previous UPSIT-NA study of 
healthy Taiwanese subjects, 10 odorants were correctly 
identified by less than two-thirds of 40 young nursing 
students. 5 Based on this result, 10 odorants from the 
UPSIT-NA were planned to be replaced to form a 
traditional Chinese language version of the UPSIT 
(UPSIT-TC); however, only 7 of these 10 odorants 
could be replaced because of the limitation of available 
odorants. "Pizza" in item 1, "smoke" in item 33, and 
"lemon" in item 36 were not replaced. In addition, "dill 
pickle" in item 25 of the UPSIT-NA was replaced be- 
cause it was unfamiliar to Taiwanese subjects. Except 
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for replacement of some odorants, some odor descrip- 
tors that were also considered unfamiliar by Taiwanese 
subjects were changed in the UPSIT-TC. In a pilot 
study of the UPSIT-TC, we compared the UPSIT-NA 
and the UPSIT-TC administered to a healthy group of 
Taiwanese subjects. In accord with the modifications, 
the scores on the UPSIT-TC were significantly higher 
than those on UPSIT-NA. 6 

Chronic rhinosinusitis (CRS) is a common etiology 
that affects olfactory function. 7,8 This study assessed 
the applicability of the UPSIT-TC in evaluating 
the olfactory function in CRS patients before and 
after functional endoscopic sinus surgery (FESS) 
and compared its applicability in patients with and 
without nasal polyps and in those whose olfac- 
tory function improved or did not improve after 
surgery. 

MATERIALS AND METHODS 

Study Subjects 

Forty healthy subjects and 100 patients with CRS 
who underwent FESS between April of 2009 and 
January of 2012 were enrolled in this study. The 
healthy subjects considered their olfactory function 
as normal, and their olfactory thresholds were 
all below —6.00 log v/v when tested by the phenyl- 
ethyl alcohol (PEA) odor detection threshold test. 1 
The diagnosis of CRS was based on a history of 
rhinosinusitis, the findings of nasal endoscopy, and 
an examination of computed tomography scans. 7 
Duration of disease was qualified by continuous 
symptoms for at least 12 consecutive weeks. Nasal 
endoscopy identified discolored nasal drainage in 
the nasal cavities, nasal polyps, polypoid swelling, 
or edema of the middle meatus or ethmoid bulla. 
Computed tomography scans revealed mucosal 
thickening and complete opacification or air-fluid 
level of one or more sinuses. Any patient who had a 
history of immunodeficiency or a previous sinus 
surgery, whose age was <20 years, or whose olfac- 
tory dysfunction was suspected to result from head 
injury or upper respiratory infection was excluded 
from the study. The patients were divided into those 
with or without nasal polyps based on endoscopic 
examination. This study was approved by the Insti- 
tutional Review Board of Taichung Veterans General 
Hospital. All participants provided written informed 
consent. 

The 40 healthy subjects (9 male and 31 female 
subjects) had a mean age of 33.1 years (ranging from 
22 to 48 years). The 100 CRS patients' (69 male and 31 
female subjects) ages ranged from 20 to 84 years, 
with a mean of 46.0 years. Among CRS patients, 
nasal polyps were present in 52 patients (37 male 
and 15 female subjects). Their ages ranged from 20 to 



78 years, with a mean of 45.6 years. Forty-eight 
patients (32 male and 16 female subjects) were with- 
out nasal polyps. Their ages ranged from 20 to 84 
years, with a mean of 46.5 years. 

Olfactory Testing 

The PEA odor detection threshold test is a forced- 
choice measure of mono-odor olfactory detection. 1 The 
odorant concentrations are presented to tester via poly- 
propylene squeeze bottles. A staircase testing proce- 
dure begins at the —6.00 log concentration with a step 
of a half-log (v/v) dilution series extending from —9.00 
log concentration to —1.00 log concentration. The dil- 
uent is light United States Pharmacopeia grade mineral 
oil. The odorant concentration is increased until correct 
detection occurs on five sets of consecutive trials at a 
given concentration. If an incorrect response occurs on 
any trial, the staircase is moved upward one full log 
step. When a correct response is made on all five trials, 
the staircase is reversed and subsequently moved up or 
down in 0.50 log increments or decrements, depending 
on the subject's performance on two pairs of trials at 
each concentration step. The geometric mean of the last 
four of seven staircase reversal points serves as the 
threshold measure. 

The UPSIT-NA and UPSIT-TC (Sensonics, Inc., 
Haddon Heights, NJ) are comprised of four 10-odor- 
ant booklets that can be self-administered in 10-15 
minutes. Each of the 40 "sera tch-and -sniff" odorants 
are embedded in 10- to 50-fim microcapsules fixed in 
a propriety binder and positioned on brown strips 
located at the bottom of the pages of each test book- 
let. 9 When the examinee takes the UPSIT-NA or 
UPSIT-TC, he/she releases each of the 40 odorants by 
scratching the strip with a pencil tip in a standardized 
manner. The identity of the released odorant is signi- 
fied by choosing a name from a set of four odor de- 
scriptors. 1 The test is scored as the number of odors 
identified correctly. A response is required for each test 
item even if no smell is perceived (i.e., the test is forced 
choice), allowing for the detection of malingering 
based on improbable responses. The UPSIT-TC differs 
from the UPSIT-NA in having eight odorant changes. 6 
"Clove" was replaced by "sandalwood" in item 8, 
"cheddar cheese" by "fish" in item 14, "cinnamon" by 
"coffee" in item 15, "gingerbread" by "rubber tire" in 
item 20, "dill pickle" by "jasmine" in item 25, "lime" by 
"grapefruit" in item 27, "wintergreen" by "magnolia" 
in item 29, and "grass" by "body powder" in item 32. 
Additionally, one descriptor, "skunk," was replaced by 
"dog" at various places, and another descriptor, 
"pumpkin pie," was removed from the UPSIT-TC. 

The healthy subjects received assessment of UPSIT-TC 
and reassessment 2 weeks later. None of the health 
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Table 1 Comparison of UPSIT-TC and UPSIT-NA scores before and after FESS 



Before FESS 



2 mo after FESS 



3 mo after FESS 



Value 



All 100 patients 
UPSIT-TC 20.81 ±8.40# 

UPSIT-NA 18.99±8.15 

Fifty-two patients with nasal polyps 
UPSIT-TC 17.69 ±7.69 

UPSIT-NA 16.17±7.51 

Forty-eight patients without nasal 
polyps 

UPSIT-TC 24.19 ±7.86 

UPSIT-NA 22.04±7.78 



21.29: 
19.93: 

20.38: 
19.10: 



22.27: 
20.83: 



8.36 
7.44 

8.31 
6.97 



:8.38 
:7.89 



21.99±7.80 
20.63 ±7.37 

21.31 ±8.03 
19.63±7.19 



22.73 ±7.55 
21.71 ±7.49 



0.028*§ 



0.01*1 
0.03*1 



0.0891 
0.3721 



*p < 0.05. 
#Mean ± SD. 

§Logistic regression using a generalized estimate equation model. 
^Repeated measures ANOVA analysis. 

UPSIT-TC = traditional Chinese version of the University of Pennsylvania Smell Identification Test; UPSIT-NA = North 
American version of the University of Pennsylvania Smell Identification Test; FESS = functional endoscopic sinus surgery. 



Table 2 Item analyses of the UPSIT-TC and the UPSIT-NA before and after FESS (n = 100) 



Item 


8 


14 


15 


20 


25 


27 


29 


32 


Before FESS 


















UPSIT-TC 


70%# 


25% 


60% 


58% 


63% 


56% 


41% 


76% 


UPSIT-NA 


38% 


31% 


31% 


45% 


25% 


19% 


30% 


37% 


p Value 


<0.001** 


0.431 


<0.001** 


0.09 


<0.001** 


<0.001** 


0.139 


<o.oor 


2 mo after FESS 


















UPSIT-TC 


71% 


22% 


56% 


54% 


58% 


64% 


31% 


78% 


UPSIT-NA 


35% 


29% 


29% 


53% 


34% 


14% 


33% 


38% 


p Value 


<0.001** 


0.33 


<0.001** 


1 


0.001** 


<0.001** 


0.88 


<o.oor 


3 mo after FESS 


















UPSIT-TC 


73% 


22% 


60% 


62% 


50% 


63% 


40% 


84% 


UPSIT-NA 


36% 


30% 


32% 


47% 


32% 


21% 


29% 


47% 


p Value 


<0.001** 


0.259 


<0.001** 


0.047* 


0.015* 


<0.001** 


0.137 


<o.oor 



*p < 0.05; **p < 0.01. 
#Rate of correct identification. 

UPSIT-TC = traditional Chinese version of the University of Pennsylvania Smell Identification Test; UPSIT = University 
of Pennsylvania Smell Identification Test; UPSIT-NA = North American version of the University of Pennsylvania Smell 
Identification Test. 



subjects reported having upper airway infection dur- 
ing the test-retest interval. All CRS patients took 
olfactory tests including the PEA odor detection 
threshold test, UPSIT-NA, and UPSIT-TC before sur- 
gery. After surgery, the patients only received local 
nasal treatment. Neither antihistamines nor oral or 
nasal steroids were prescribed. At 2 and 3 months 
after FESS, they took all of the three olfactory tests 
again. When the PEA thresholds were compared 
before and 3 months after FESS, patients were di- 
vided into those whose PEA thresholds improved 
after surgery (decreased PEA thresholds) and those 



whose PEA thresholds did not improve (unchanged 
or increased PEA thresholds). 

Assessment of the Reliability and Validity of 
UPSIT-TC 

The reliability of UPSIT-TC was assessed with in- 
ternal consistency and test-retest reproducibility. 
The internal consistency was evaluated with Cron- 
bach's a coefficient. The generally acceptable Cron- 
bach's a is >0.7. The test-retest reliability was as- 
sessed by the correlation between the scores of the 
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Table 3 Item analyses of the UPSIT-TC and the UPSIT-NA in patients with or without nasal polyps 



Item 


8 


14 


15 


20 


25 


27 


29 


32 


Fifty-two patients with nasal polyps 
Before FESS 














UPSIT-TC 


61.5%# 


26.9% 


cno/ 

50 % 


rr OO/ 

55.8% 


/I £. TO/ 

46.2 To 


A T OO/ 

42.3% 


n /~ co/ 

36.5% 


/" O CO/ 

63.5% 


UPSIT-NA 


28.8% 


25% 


1/ no/ 

26.9 % 


/I T O 0/ 

42.3% 


T CO/ 

25 /o 


1 n to/ 

19.2% 


T CO/ 
25/o 


OO CO/ 

38.5 /o 


p Value 


0.002** 


1 


n nTT* 
0.02/ 


n Ton 

0.239 


0.041 


n m n* 
0.019 


n too 

0.288 


n m n* 
0.019 


2 mo after FESS 


















UPSIT-TC 


71.2% 


26.9% 


C7 TO/ 

57.7 % 


ct to/ 

57.7 % 


en /" o/ 

59.6 /o 


en /'o/ 
59.6/o 


TO OO/ 

28.8% 


7CO/ 

75% 


UPSIT-NA 


25% 


28.8% 


25% 


/l /I TO/ 

44.2 7o 


/in ao/ 
40.4 To 


n /^o/ 
9.6/o 


t/~ no/ 

26.9% 


/in /i 0/ 
40.4/o 


p Value 


<0.001** 


1 


0.001** 


0.239 


0.078 


<0.001** 


1 


0.001** 


3 mo after FESS 


















UPSIT-TC 


76.9% 


23.1% 


C7 TO/ 

57.7 % 


1 CO/ 

61.5 To 


cri no/ 

5i. y yo 


/" CC /I 0/ 

65.4/o 


O /" CO/ 

36.5% 


OO TO/ 

83.7% 


UPSIT-NA 


28.8% 


25% 


TO OO/ 

28.8 % 


36.5 To 


O /l /" 0/ 

34.6% 


t/~ no/ 
26.9/o 


O T TO/ 

32.7% 


/i 0 1 0/ 
4o.l/o 


p Value 


<0.001** 


1 


0.006 


n m n* 
0.019 


(J. 113 


^n nm 
<0.001 


n 017 

0.827 


^n nm ** 
<0.00i 


Forty-eight patients 
Before FESS 


without nasal polyps 














UPSIT-TC 


79.2% 


22.9% 


Tn oo/ 

70.8 % 


/Tl A 0/ 

60.4 To 


O 1 O 0/ 

81.3 7o 


7n 00/ 
70.8/o 


/l c 00/ 

45.8/0 


on /~ 0/ 

89.6 /o 


UPSIT-NA 


47.9% 


37.5% 


o c /i o/ 

35.4% 


/i "7 no/ 
4/.9/0 


25 7o 


1 O OO/ 

18.8 /o 


O C /I 0/ 
35.4/o 


O C /I 0/ 

35.4/o 


p Value 


0.003** 


0.182 


n nm 
0.001 


n on/' 

0.306 


^n nm 
<0.001 


^n nm 
<0.001 


n /in/" 

0.406 


^n nm ** 
<0.001 


2 mo after FESS 


















UPSIT-TC 


70.8% 


16.7% 


C /I TO/ 

54.2 7o 


50 To 


C/~ O 0/ 

56.3% 


0 00/ 
68.8/0 


TO OO/ 

33.3% 


01 00/ 

81.3% 


UPSIT-NA 


45.8% 


29.2% 


33.3% 


62.5% 


27.1% 


18.8% 


39.6% 


35.4% 


p Value 


0.023* 


0.225 


0.064 


0.304 


0.007 


<0.001** 


0.671 


<0.001** 


3 mo after FESS 


















UPSIT-TC 


68.8% 


20.8% 


62.5% 


62.5% 


47.9% 


60.4% 


43.8% 


85.4% 


UPSIT-NA 


43.8% 


35.4% 


35.4% 


48.3% 


29.2% 


14.6% 


25% 


45.8% 


p Value 


0.024* 


0.173 


0.014* 


0.835 


0.093 


<0.001** 


0.086 


<0.001** 



*p < 0.05; **p <0.01. 
#Rate of correct identification. 

UPSIT-TC = traditional Chinese version of the University of Pennsylvania Smell Identification Test; UPSIT-NA = North 
American version of the University of Pennsylvania Smell Identification Test; FESS = functional endoscopic sinus surgery. 



two UPSIT-TC tests taken 2 weeks apart by 40 
healthy subjects without olfactory changes during 
the period. In general, an acceptable test-retest reli- 
ability coefficient score is >0.7. 10 A correlation as- 
sessment between UPSIT-TC scores and PEA thresh- 
olds was obtained with the Pearson's correlation 
coefficient and was used to analyze the concurrent 
validity of the study instrument. Logistic regression 
through a generalized estimating equation model 
was used to predict the UPSIT scores with indepen- 
dent variables including test occasions (before or 
after FESS), test methods (UPSIT-NA or UPSIT-TC), 
status of polyp (with or without), and PEA thresh- 
olds (improved or did not improve). In addition, 
known group validity was used to assess whether 
the UPSIT-TC was able to discriminate between 
known groups, e.g., healthy subjects with normal 
olfaction and CRS patients, CRS patients with or 
without polyps, and CRS patients whose PEA 
thresholds improved or not. The repeated measures 



ANOVA analysis was used for comparing the scores 
of UPSIT-TC or UPSIT-NA before and after FESS. 
The independent f-test was used to analyze the be- 
tween-group differences. The frequency of correct 
identification of the eight replacement items in the 
UPSIT-TC was compared with the frequency of cor- 
rect identification of the eight original items in the 
UPSIT using chi-square analysis. All computations 
were performed using SPSS Version 17.0 (SPSS, Inc., 
Chicago, IL). Two-tailed values of p < 0.05 were 
considered statistically significant. 

RESULTS 
Reliability 

Cronbach's a was 0.887, 0.886, and 0.870 at three test 
occasions of CRS patients. Pearson's correlation analy- 
sis computed across the two test occasions of healthy 
subjects without an olfactory change was 0.664 (p < 
0.001). 
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Table 4 Item analyses of the UPSIT-TC and the UPSIT-NA in patients whose PEA test thresholds improved 
or did not improve after FESS 

Item 8 14 15 20 25 27 29 32 



Forty-four patients whose PEA thresholds improved after FESS 
Before FESS 



UPSIT-TC 


70.5%# 


27.3% 


54.5% 


63.6% 


70.5% 


56.8% 


47.7% 


72.7% 


UPSIT 


43.2% 


27.3% 


27.3% 


45.5% 


31.8% 


22.7% 


29.5% 


43.2% 


p Value 


0.018* 


1 


0.017* 


0.134 


0.001** 


0.002** 


0.125 


0.01* 


2 mo after FESS 


















UPSIT-TC 


88.6% 


20.5% 


65.9% 


59.1% 


72.7% 


75% 


36.4% 


97.7% 


UPSIT 


43.2% 


34.1% 


34.1% 


61.4% 


45.5% 


9.1% 


43.2% 


45.5% 


p Value 


<0.001** 


0.231 


0.006** 


1 


0.017* 


<0.001** 


0.663 


0.001** 


3 mo after FESS 


















UPSIT-TC 


93.2% 


27.3% 


72.7% 


72.7% 


65.9% 


75% 


54.5% 


90.9% 


UPSIT 


40.9% 


34.1% 


34.1% 


59.17% 


40.9% 


20.5% 


50% 


52.3% 


p Value 


<0.001** 


0.644 


0.001** 


0.261 


0.033* 


<0.001** 


0.831 


<0.001** 


ifty-six patients whose PEA 


thresholds 


did not improve after FESS 








Before FESS 


















UPSIT-TC 


69.6% 


23.2% 


64.3% 


53.6% 


57.1% 


55.4% 


35.7% 


78.6% 


UPSIT 


33.9% 


33.9% 


33.9% 


44.6% 


19.6% 


16.1% 


30.4% 


32.1% 


p Value 


<0.001** 


0.296 


0.002** 


0.45 


<0.001** 


<0.001** 


0.688 


<0.001** 


2 mo after FESS 


















UPSIT-TC 


57.1% 


23.2% 


48.2% 


50% 


46.4% 


55.4% 


26.8% 


62.5% 


UPSIT 


28.6% 


25% 


25% 


46.4% 


25% 


17.9% 


25% 


32.1% 


p Value 


0.004** 


1 


0.019* 


0.85 


0.03* 


<0.001** 


1 


0.002** 


3 mo after FESS 


















UPSIT-TC 


57.1% 


17.9% 


50% 


53.6% 


37.5% 


53.6% 


28.6% 


78.6% 


UPSIT 


32.1% 


26.8% 


30.4% 


37.6% 


25% 


21.4% 


12.5% 


42.9% 


p Value 


0.013* 


0.364 


0.054 


0.129 


0.221 


0.001** 


0.061 


<0.001** 



*p < 0.05; *p < 0.02. 

#Rate of correct identification. 

UPSIT-TC = traditional Chinese version of the University of Pennsylvania Smell Identification Test; UPSIT = University 
of Pennsylvania Smell Identification Test; UPSIT-NA = North American version of the University of Pennsylvania Smell 
Identification Test; FESS = functional endoscopic sinus surgery; PEA = phenylethyl alcohol test. 



Validity 

Concurrent Validity. Patients' response to the PEA 
odor detection threshold test and UPSIT-TC was 
compared at each of three time points: before sur- 
gery and 2 and 3 months after surgery. Pearson's 
correlation coefficients of the PEA thresholds and 
UPSIT-TC scores indicate a good correlation between 
two instruments (before surgery, correlation coeffi- 
cient = -0.700 and p < 0.001; 2 months after FESS, 
correlation coefficient = —0.738 and p < 9.001; 3 
months after FESS, correlation coefficient = —0.581 
and p < 0.001). 

Responsiveness 

Sensitivity to Clinical Changes. The mean UPSIT-NA 
and UPSIT-TC scores before and after FESS are listed 
in Table 1. Logistic regression through a generalized 



estimating equation model was used to predict the 
UPSIT scores with independent variables including 
test occasions (before or after FESS), test methods 
(UPSIT-NA or UPSIT-TC), status of polyp (with or 
without), and PEA thresholds (improved or did not 
improve). The UPSIT-TC scores were significantly 
higher than those of English version (p = 0.028, 
adjusted for test occasions, polyp status, and PEA 
thresholds). 

When patients were further divided into patients 
with CRS with or without polyps, there were signif- 
icant differences between pre- and post-FESS scores 
of UPSIT-TC and UPSIT-NA in patients with polyps 
(p = 0.01 and 0.03, respectively). However, there 
were no significant differences between pre- and 
post-FESS scores of UPSIT-TC or UPSIT-NA in pa- 
tients without polyps (p = 0.89 and 0.372, respec- 
tively). 
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Table 5 Comparison scores of UPSIT-TC between 
subgroups 



UPSIT-TC p Value 



Fifty-two patients with 0.0013*§ 
nasal polyps 
Before FESS 17.69 ±7.69# 

2moafterFESS 20.38 ±8.31 

3 mo after FESS 21.31 ±8.03 

Forty-eight patients 
without nasal 
polyps 

Before FESS 24.19 ±7.86 

2 mo after FESS 22.27±8.38 

3 mo after FESS 22.73 ±7.55 

Forty-four patients whose PEA <0.0001*§ 
thresholds improved after FESS 
Before FESS 21.50 ±8.80 

2 mo after FESS 24.61 ±6.99 

3 mo after FESS 25.68 ±6.82 
Fifty-six patients whose PEA 

thresholds did not improve after 
FESS 

Before FESS 20.27±8.10 

2 mo after FESS 18.68±8.47 

3 mo after FESS 19.09 ±7.32 

*p < 0.01. 
#Mean ± SD. 

§Logistic regression using a generalized estimate equation 
model. 

UPSIT-TC = traditional Chinese version of the University 
of Pennsylvania Smell Identification Test; FESS = func- 
tional endoscopic sinus surgery; PEA = phenylethyl alcohol 
test. 



Rates of Correct Identification. The rates of correct 
identification of the eight replaced odorants in UPSIT-TC 
before and after surgery are listed in Table 2. The rates 
of the correctly identified odorants in all 100 patients 
were significantly higher for items 8, 15, 25, 27, and 32 
in the UPSIT-TC than in the UPSIT-NA before FESS 
and 2 and 3 months after FESS. The rate of correct 
identification of item 20 was also significantly higher in 
the UPSIT-TC 3 months after FESS. 

Patients were categorized into CRS with or without 
nasal polyps with the rates of the correctly identified 
odorants for each group listed in Table 3. The rates of 
the correctly identified odorants in patients with nasal 
polyps were significantly higher for items 8, 15, 27, and 
32 in the UPSIT-TC than in the UPSIT-NA before FESS 
and 2 and 3 months after FESS. The rate of correct 
identification was also significantly higher for item 25 
before FESS and for item 20 3 months after FESS. The 
rates of the correctly identified odorants in patients 



without nasal polyps were significantly higher for 
items 8, 25, 27, and 32 in the UPSIT-TC the in UPSIT- 
NA before FESS and 2 and 3 months after FESS. The 
rate of correct identification was also significantly 
higher for item 15 before FESS and at 3 months after 
FESS. 

The rates of correctly identified odorants for sub- 
groups of patients whose PEA thresholds improved or 
did not improve after surgery are listed in Table 4. The 
rates of the correctly identified odorants for patients 
whose PEA thresholds improved after FESS were sig- 
nificantly higher for items 8, 15, 25, 27, and 32 in the 
UPSIT-TC than in the UPSIT-NA before FESS and 2 
and 3 months after FESS. The rates of the correctly 
identified odorants in patients whose PEA thresholds 
did not improve after FESS were significantly higher 
for items 8, 27, and 32 in the UPSIT-TC than in the 
UPSIT-NA before FESS and 2 and 3 months after FESS. 
The rate of correct identification was also significantly 
higher in items 15 and 25 before FESS and 2 months 
after FESS. 

Known Groups Validity. The independent £-tests were 
used to compare the UPSIT-TC scores of healthy sub- 
jects with normal olfaction to the scores of the CRS 
patients before surgery. The mean UPSIT-TC score of 
healthy subjects was 33.18 ± 2.85 and was 20.81 ± 8.40 
for CRS patients. There were significant differences in 
the UPSIT-TC scores between the two groups (p < 
0.001). 

When UPSIT-TC scores were used as the dependent 
variable of logistic regression analysis using a general- 
ized estimating equation model, the UPSIT-TC scores 
of the nonpolyp group were significantly higher than 
those of the polyp group (p = 0.0013, adjusted for test 
occasions and PEA thresholds). In addition, the 
UPSIT-TC scores of patients whose PEA threshold im- 
proved were significantly higher than those of patients 
whose PEA thresholds were unchanged or decreased 
(p < 0.0001, adjusted for test occasions and polyp sta- 
tus; Table 5). 



DISCUSSION 

A number of clinical olfactory tests have been ad- 
ministered to Taiwanese subjects, including the UPSIT; 
detection threshold tests; Sniffin' Sticks; and a range 
of odor identification, discrimination, and memory 
tests. 4 ' 7,11-15 The UPSIT, the most commonly used 
smell test in the world, has the advantages of self- 
administration and good validation. However, like 
other odor identification tests, it is influent by culture 
factors, which has led to the development of a number 
of culture-specific versions of the test. 16-18 CRS is one 
of the most common etiologies for olfactory dysfunc- 
tion. 7,8 Therefore, we chose the CRS cohort for valida- 
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tion of UPSIT-TC. It is believed that CRS patients with 
nasal polyps tend to have more olfactory loss than 
those without nasal polyps. 19 Perry et al. 19 reported 
that patients with polyps had a higher preoperative 
olfactory dysfunction than those without polyps, and 
they had a higher improvement rate in olfaction 1 year 
after FESS. The short-term postoperative olfactory 
function showed significant improvement in our pa- 
tients with polyps. However, our previous studies 
found that there were no significant differences in 
postoperative olfaction function between patients with 
or without polyps 6 months after FESS. 7 The prognosis 
of olfaction after FESS depends on many factors includ- 
ing patients' olfactory reserve, surgical correction of 
the blocked olfactory cleft, and ongoing medical treat- 
ment. 20 The discrepancies in the results of olfactory 
function changes after FESS in the literature are likely 
reflecting differences in severity of enrolled CRS pa- 
tients as well as different methods and time of olfac- 
tory testing. 

Reliability is defined as the consistency or stability of 
the measuring instrument. The internal consistency in- 
dicates the homogeneity of the instrument. We ob- 
tained the internal consistency of UPSIT-TC through 
calculation the Cronbach's a value. The generally 
acceptable Cronbach's a is >0.7. Cronbach's a of 
UPSIT-TC was 0.887, 0.886, and 0.870 at three test 
occasions in CRS patients. Test-retest reproducibility 
measures the stability of an instrument tested on different 
occasions. We found that the UPSIT-TC scores signifi- 
cantly correlated to the retest results. Our results indi- 
cated good internal item homogeneity and test-retest 
correlation, indicating good reliability of the UPSIT-TC. 

Validity involves the accuracy of the instrument, 
showing whether the instrument measures what it is 
supposed to measure. Concurrent validity is often used 
to validate a new test. Two concurrent measures are 
used to test each examinee, and the correlation of the 
results of two tests is then analyzed. In this study, we 
found the scores of UPSIT-TC had a strong correlation 
to PEA thresholds. Discriminant validity is the ability 
to distinguish among disease-affected patient groups 
and nonaffected groups. We found that the scores of 
UPSIT-TC were effective in distinguishing healthy vol- 
unteers with normal olfaction and CRS patients with 
olfactory dysfunction. When patients were divided 
into those with or without nasal polyps or those whose 
PEA thresholds improved or did not improve after 
FESS, the mean UPSIT-TC scores of patients who had 
CRS without polyps were significantly higher than 
those of patients who had CRS with polyps. In addition, 
the UPSIT-TC scores of patients whose PEA thresh- 
olds improved were significantly higher than those 
of patients whose PEA thresholds did not improve. 
Furthermore, the mean UPSIT-TC scores were signif- 
icantly higher than those of the English version UP- 



SIT after adjusting for test occasions, polyp status, 
and PEA thresholds. The UPSIT-TC clearly detected 
improved performance of CRS patients from a Tai- 
wanese population. 

In a pilot study of the UPSIT-TC administered to a 
healthy group of Taiwanese subjects, the rate of correct 
identification was higher than 70% for seven items 
among the eight items in which odorants had been 
replaced in the UPSIT-TC. 6 In this study, we evaluated 
the olfactory function of CRS patients and found that 
the UPSIT-TC scores were significantly higher than 
those of the UPSIT-NA. In addition, the rate of correct 
identification was clearly higher in five items (items 8, 
15, 25, 27, and 32). Future versions of this test will focus 
on further improving the test scores so that they will be 
comparable with those obtained from North American 
subjects, thereby allowing for the use of the same nor- 
mative tables. In conclusion, the UPSIT-TC clearly re- 
sulted in improved performance by individuals from a 
Taiwanese population. 
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